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ABSTRACT 

DIAGNOSTIC INSTRUMENT FOR ASSESSING THE SKILLS 
AND ATTITUDES OF REFERENCE LIBRARIANS' 




The test develope^^j^ifepSper,,. assesses several major skills 



of reference librarians: question analyst^^w^tion of appropriate 
source, and actual use of the source, including selection^^^appropriate 



subject terms, through simulated reference questions and |^ search * J 
S^erclse in a standardized list Of subject headings* It also provides*' 
a means of determining the attitudes of reference librarians toward 
problem-solving, direct and indirect reference work, and instructional 
and informational modes of service. Th6 test has been used with 
foreign librarians employed in U. S- Information Agency libraries in 
Europe, thp Middle East, andVtorth Africa, and with library school students 
at the University of Maryland, where it is used to evaluate students 
seeking to waive the basic reference course because of previous related 
course work or experience* 
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DIAGNOSTIC INSTRUMENT FQR ASSESSING THE SKILLS 
§ AND ATTITUDES OF REFERENCE LIBRARIANS 

IfctfftODUCTION- 

j$y This diagnostic instrument i's a modification of a test developed 

^ ta, assess the skills and attitudes of participants in the U, S. 

* — ^ 

Information Agency Training Program, for European Librarians, Catholic 

1 * 

University of America, 1977. It has been used for a similar workshop 
given in 1978 for librarians in the .Agency's libraries in the Near 
East and North Africa and to assess.students seeking waiver of the 
basic reference course at the University of Maryland, College of 
Library and Information Services, /* 

The following is a brief outline 'of the instrument, which is 
* .included in Appendix A: * } 

Section 1. Simulated reference questions 
Section 2. Identifying relevant subject headings 
Section 3. Attitudes towarjd* direct and indirect reference service 
Section 4. Attitudes toward*ir\&tructional and informational reference 

' * ' ■' ' ■ 

^ service 

Section 5. Attitudes toward problerti-solving • 
j Time for completion ranges from lfc to 31 hours, with the difference due 

r-i . ' / 

Ji , primarily- to speed in completing Section li The respondent must have 

\ i * *\ * * * " - 

access to a reference collection likely to contain the reference sources 



y listed in the key to Section 1 (Apperidix . Sections 2<Tthrough 5 are 
iSelf -contained . * : 




The test does not assess online searching skills. The USIA librarians 
did not haxe these skills, and students waiving the basic course at 
Maryland are urged to take a course which incorporates the use of online 
^ystems if they do not already have these skij^Ls. 

t. 

■'i " 

^piDELINES FOR INTERPRETING RESULTS 



eference Skills 



Section 1 contains fourteen questions designed to test the respon- 
^dent's knowledge of search heuristics likely to be developed during 
a basic reference course or through reference experience. These include, 

!f for example 5 identifying a recent book by reference to the subject*, 

i* 

* updating a biographical entry, reading a statistical table. All of the 

! 

, answers can be located in reference sources usually contained in a x 
medium-sized public library or in an undergraduate academic library ' 
collection. -A key is included in Appendix B for these questions 5 indicating 
one or several sources of the Correct answer. 

In assessing this portion of the test, answers which do not match 

the key should be checked for accuracy. Two scores should be determined: 

y 

percentage correct responses of all possible responses, based on fourteen ^ 
questions, counting the parts of questions separately; and time per correct 

answer. The latter is computed by dividing the total tim& required to' , 

i * 
answer the questions, rounded to the nearest 15^minute interval, by 

numbef of correct answers, - 

To allow for variations in response caused by collection quality, 

the directions ask the respondent to include search strategy development 

for questions which could not be' answered. Included in the strategy is , 

identification of the generic tool, with its qualifiers, which should 
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5. 



logically contain the answer. In Question 2, for example, the strategy 
should indicate^"a map of Illinois with counties and'county seats, likely 
to be found in a U. S. atlas. The examiner can judge the effectiveness 
and logic of the search strategy. If L the test collection i^ unknown, 
the examiner may provide^ the respondent after the test with a list 
of sources containing the answers and ask him to identify those in 
the test collection. This information, together with strategy, allows 
the examiner to attribute the reason for performance failure to collection 

4 

quality, knowledge of the collection, or use of sources. 

. The second segment evaluates the librarian's ability to select ' 
useful subject headings from thelibrary of Congress 1 Subject Headings 
and to 'modify a search using standardized subject terminology. This 
exercise provides a basis for assessing the librarian's skill at con- 
ducting subject searches in a card catalog since this system is used 
widely to provide subject access to books and other library materials* 

The specific objectives of the four questions in this section 
are to evaluate the respondents ability to interpret: 

- a scope note, explaining coverage of a particular term 

- a see also raferende to a related subject heading 

- subdivisions of subject headings, i.e.' hierarchical arrangement/ arid j 
fornusubheadings 

- a see reference from an entry term to the standard term 

The score - is the number of correct answers, and should be accompanied 
by a diagnosis of the reasons for' error, based on the objectives indicated, 
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Attitudes Toward Reference Work 

■ & 

^Sections 3 through 5 assess attitudes which affect job performance 

in reference. Section 3 assesses the preference for direct or indirect 

reference work, 'Direct reference involves direct personal contact* with 

the user, usually by answering reference questions at a reference "desk 

or through bibliographic instruction; indirect is supportive of this 

direct contact, frequently through bibliographic activities, but involves 

little personal interaction with the user* Ingfthis seJtion> Questions 1, 

5, and 7 relate to direct service; 2* 3 5 6, 8, and 9 to indirect service. 

Ideally there should be some blending of the two groups* but an obvious J 

preference for indirect reference service may suggest an inability to work 

well with the public, * • <- 

Section b asks the respondent to indicate his preference for 
teaching the user how to £ind the information or actually providing the 
information. The latter is more closely aligned with special reference 
service* the former with public or academic library service. There is 
feome indicatioi that librarians who feel inadequate for one reason 6r 
another in dealing with a patrort are likely to prefer an instruetional 
approach* but this is not, the only reason for this preference, and it 
may simply reflect a philosophical orientation t6 a librarian's role* 
Many librarians philosophically view themselves as teachers and the 
library as an institution for "self ;education and 't*hus espouse the ijistruc- • 
tional mode of service. * ^ 

The last section incorporates *an instrument to assess attitudes # 
toward problemrsolving devised by Carey ^L958)> The emphasis fn this 
instrument is on "attitudes , not on capability;- howe\%f, the'scale derived 



from this instrument has predictive validity in that the scores have a 
positive relationship to performance in experimental problem-solving 
situations. The scale is not included in Appendix A, but is reprinted in: 
Marvin E* Shaw and 3ack M. Wright, Scales for Measurement of Attitudes 
(New York: McGraw Hill, 1967), pp. 268-70, 

To score this section* "response alternatives for positive statements 
should be weighted from 5 (strongly agree or almost always) to 1 (strongly 
disagree or almost never). Weights for negative items (Questions 9, 1^> 
15, 18) should be reversed. A person's score is the sum of the weighted 
alternatives he endorses- High scores indicate a positive attitude toward 
problem-solving situations and demands" (Shaw and Wright, 1967). The mean 
s score for females is £7.61, for males 62.12. Respondents scoring high on 
,( this section should function effectively in the problem-solving aspect 
* Qf reference. • • . 
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FOOTNOTES 

^The author was Coordinator of Curriculum and Instruction 
for the 1977 training program, Project Director for the 1978 
program. 
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. Appendix A - 7 

; 4 . 

DIAGNQSTIt INSTRUMENT FOR ASSESSING THE SKILLS AND 
ATTITUDES OF REFERENCE LIBRARIANS' 

This diagnostic instrument is designed to provide information 
about your skills in and attitudes towar4 reference work. You should^ 
wor^ alone* and follow the directions given for each section. Time 
to be allocated for completion of each section is indicated with 
e,ach section. The order may be shifted at the examiner's discretion. 
Please read the direcjrions for each section completely before starting 
each section. 



.Section 1- SIMULATED REFERENCE QLESTIONS (3 hour maximum* 

Directions: Approach all questions as though they were^ actual \ ■ 
questions and locate an appropriate response. You may. 
consult any source 'except another person. For all questions,* provide 
a brief citation to the actual source of the answer, including the 
entry under which, it was located. Example: Diet, of Ajik Biog\, v, V v 
.p. 170, under Adanis, H. Eft For the "asterisked questions, also provide 
the answer briefly. - ; - 4 

If you cannot locate the answer , please do the following: 

- list the first three sources you tried, including the entry. 

Example: Current Biog., 1956, Xinder. Smith, 0, G . ; Who's Who in 

America, 1957, under Smith, David; Ency. Brit, / under , 
Smith, David G. 

- then, describe the kind of reference work In which you think you 
could find the answer, including appropriate qualifiers. 

Example: A retrospective biographical source covering American 
statesmen with name access 

IMPORTANT - - -Please note the time it takes you to complete this 
segment of the test and indicate it at the end of 
the questions* You may not take longer than three hour$. 
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Questions; 

^) Is Irving Berlin still alive? 

2) "What is the county seat of Kqox County, Illinois? * 

3) Churchill first used the term Iron Curtain in\ speech he made 
.in the U, 5* When and where did he make this speech? > y 

4) Car> you locate a copy of it for me? (Bibliographfcally, not physically) 



5) I know that the Secret Service has responsibility for providing body- 
guards for certain public officials and the^r families under law, * 
Who falfs under their protection, 1 do not need specific names - w 
titles or relationships will be sufficient. 



6) Elihu* Root was a note*! Republican Senator in the early part of the 
20th centui^y* what was" his position regarding the*League of 
^ Nations , wh%n American membership was being discussed in Congress? 



7) How many American married women with children un<ter schoc/1 
jvefe employed in 1977? T ' 



8) I need a bibliographic citation to the hearings on. the effectiveness 
of federal bank -regulation that were held in Congress in Spring, 197#* 
They related to the Franklin National Bank failure. 



9) What was the name' of the black woman singer Vfho sang at President 
.Lyndon Johnson's funeral? ' v 



10) 



i 

What newspaper 'in St'.; Louis has the largest circulation?" 
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* Questions (Continued); 



> 11) During his .first term of office, President Nixon encountered 
major difficulties in securing senatorial approval of his 
appointees to the Supreme Court. Justice Rehnquist was 
* approved it* 1971, but only after critical scrutiny. What 

• * were, tfie major objections to him? 1 . ' 



* 12) How did Senator P*oxmire vot£ on his confirmation? 



* 13) r need the author and title of a fairly recent (i.e., published 

between 1978 and 1981) book about Newfields, the planned community 
in Ohio. ^ . \ . 



14) Where can- I find a picture of the Picasso sculpUtfe he donated 
*to the city of Chicagb,^the rust-colored one that is in. the 
plaza of th£ Chicago Civic Center? / * 



Time for completion ({& specific): 



\ 



13 
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Section 2: IDENTIFYING RELEVANT SUBJECT HEADINGS (15 minutes) 



Directions: Attached is a page of subject headings from the Library of 
Congress Subject Headings (8th ed.). Using the entries on 
this p.age t select the subject heading you would search under first to 
locate the following books in your catalog. (Remember your entry should 
always betthe most specif ic possible.) 



1) A book on J British civil service polities about the hiring of nationals 
% in India in the nineteenth century: 

2) A book on the sociology of the bureaucracy wl^ich analyzes several 
government agencies: Q 



3) A handbook on how to get minority groups to apply for civil service 
jobs: 



*0 How can I broaden my search in no* 3 if there are x no books under that\ 
.subject heading? ( 1 



What kind of irrelevant material would I get with this approach? 



U. S, Library of Congress, Subject Headings , v.* I (Washington* 1975) , 351. 



Chffl service (Direct) (JF1S2M67I; 
Cbioautl, JV443-3; Municipal 
JSI4&I63; State l**or, t 
MDS0H-S023; United States, 
JK63I-90I; Other countries, JS JQ) 

Her* ere entered works on career govern* 
men t service and the U w% governing it 
Work* on government service, includ- 
ing thai by political appointment or 
employment contract, are entered un- 
der the name of the country state* or 
dty, with the subdivision Official* and 
employees. Works on personnel of a 
specific government agency are en* 
tcred under the name of that a§ency, 
^ with the subdivision Officials and em* 
ployees, 
$* Administrative Isw 

Applications for office 

Bureaucracy 

CSvi] ust . 
Qvil service pensioners ^ 
Collective bargaining— Government 

employees 
Collective labor agreements — Municipal 

employees 
Correctional personnel 
Employee-management relations in 

government 
Government business enterprises — 

Employees * 
Local official* and employees 
Misconduct in office 

Municipal official* and employees , 
Public officers 

Strikes an&lockouts — Qvil service 

Trade - unions — Government employees 

Uniform*) Civil 

Women J^the civil setyiee 

subdivision Officials tft& employees — 
Appointment, qualifications, tenure* 
etc, under names of countries, does, 
etc, eg, United States — OffteUis and 
employees — Appointment, 
qualifications* tenure* etc 
x Administration 

Government employees 

Office, Tenure of 

Tenure of oflpec 
xx Administrative law 

Bureaucrat)!. 

Political science 

Public administration 

Public officers 
— Anecdotes, 'face tiae t satire* etc 



- Sec GvO service* Colonial 

— Ethics 

See Civil service ethics 
— JEiaminetioo* (United Sates, JK7I6) 
at subdivision Officials and employees 
— Euminations under names 0/ 
cities sod towns 
x Civil service examinations 
Competitive examination* 
xx Examinations 

— Examinations, questions, etc 

— Political activity 

Here are entered general works on po], 
jticsl activities of civil servants. 
Works limited to particular locatf- 
* . tie*, are entered under names of 
countries, cities, etc with subdivi. 
lion OfHc iaU and employee* — Fell* 
4 ttasl sctivity. 
§ Government employees* political 
activities 
*% xx Public administration * 



— Positions 

See Civil service positions 

— Rtt nn'ting 

. See Qvil service recruiting 

— Salaries j 

Here ' are 'entered general works on 
civil tefvicc salaries. Works limited 
to particular localities are entered 
under the name of the country* city, 
etc.* with subdivision Officials and 
employee* — Salaries* allowances* 
eto. e.g United State* — Officials 
and employees — Salaries, allow* 
ances, etc. Works limited to specific 
departments or institutions are en* 
■ tered under toe name of the depart* 

ment or institution* with subdivi* 
eion Appointments, promotions* sa* 
lariett etc* eg. United States, 
* „ # Dept. of Agriculture — Appoint* 

meots, promotions, salaries* etd 

— Study and leaching (Direct) 

u Interns (Civil service) 

— Subject headings 

See Subject headings— Civil service 

— Supplementary employment 

xx Conflict of interests (Public office) 
Example under Supplementary employ* 
ment 

— Underdeveloped areas 

See Underdeveloped areas — Civil 
service 

— - Veterans 1 preference ' (Direct) 
* x Veteran preference t 

Veterans' prefereoce * 
xx Veterans — Employment 

— Vocational guidance ' 

^ See Civil service positions 

GEOGRAPHIC SUBDIVISIONS 

— rcountryj 
Colonies 

Note under Qvti service* Colonial a 

GEOGRAPHIC SUlDfVtSlOKS 

— United States 

* United States—Civil service 

OEOOJUPHIC suwhvisions 

State* 

ChU serrfc*, Catania] 

Here are entered general and com pars* 
rive works only. Works on dvi] service 
of the colonies of an individual country 
are entered unoer the heading Civil 
service with subdivision rcountryj — ' 
Colonies- Works* dealing with i spe- 
cific colony are entered under the 
' same heading* subdivided by the name 

of the colony. 
x Civil service Colonic* 
Colonial civit service 
Colonies—Civil service 
Colonic* — Officials and employees 
Qvi] service, International 

Sec International officials and employees 
Civil service, Municipal 

See Municipal officials and employees 
QvO aerrice ethka 

x Qvil service— Btbic* 
xx Political ethics 
Qvil service examinations 

Sec Qvil service 
QvH service interns 

See Interns (Qvil service) 
Qvil service Jobs 

Sec Gvfl service positions 



QvD service nasal mar* (Direct) 
sa Civtl service pensions 
x Pensioners, Civil service 
Retired government .officials and 
employees 
xx Civil service 

Civil service* retirement 

— United States 

xx United State*— Officials and 
employee*, Retired 
QvO service nensisat (Direct) (JFI67I; 
United States, JK791) 
u Survivors' benefits 

tubdjvifcoD Officials and employees — 
. Pensions under names of particular 
departments, c+g> United States. 
Federal Bureau of Investigation — 
* Officials and employees — Pensions; 
eho subdivision Pensions and 
. Salaries* pensions* etc * under names 
of industries, professions, etc., eg. 
Lawyers— Pension Teachers- 
Salaries, pensions* etc 
x Pensions* Civil 

Retirement pensions 
xx Civil service pensioners 
Civil service retirement 
Old sge pension* 
Pensions v 
— Cost-ofrliving adjustments (Direct) 
x Cost-of-living pension adjustments 

— Finance 

— Tables and ready-reckoners 

— Taxation (Direct) 

— Unclaimed benefits * 

x Benefits* Unclaimed (Civil service 
pensions) 
Unclaimed, benefits of civil service 
pensions 

GEOGRAPHIC SUBDIVISIONS 

— United States 

x United States— Pensions* Qvi] „ 
service 

GEOGRAPHIC SUlDmslONS 

, States * . 

Qvil service podtfa«s (Direct) 

sa subdivision Positions under names of 
* -individual government departments 
*or agencies, eg. United 'States. War 
Dept-rPositions x 
x Qvi] service jobs 
4 Qvi] service — Positions 

Qvil service— Vocational, guidance 
Government jobs 
* Government positions 
xx Occupations 
—Classification 
' sa subdivision Officials and employee* 
—Salaries, allowances* etc. under 
names of countries, states, cities, 
or*mdividuai government agencies 
1 — Juvenile literature * ^ 
QvD service reendthag (Direct) 
x Qvil service — Recruiting 
xx Recruiting of employees 
CtvO service reform (United States, 
JK6SI-699) 
$a Corruption (in politics} 

Patronage* Political 
s Merit svstem 
Spoils system 
xx Patronage* Political 
Qvil service rttfreaient (Direct) 
sa CrVfl service pensioners 
- Qvil service ] 
% xx Retirement 
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Section 3; ATTITUDES TOWARD DIRECT AND INDIRECT REFERENCE SERVICE 

Directions: The questions in this section will, involve yourjnaking 

judgments about the tasks described below* They are tasks 5 
performed normally in reference departments > Please read them carefully ff 
and t if necessary, refer back to them when responding to the questions* 

1) Finding a factual answer for a patron 

2) Writing an administrative report on reference services 

3) Developing a referral file j 

4) Evaluating a portion of the library's reference collection 

5) Explaining to a user how to use a particular reference tool 

6) , Preparing a selection policy for reference materials in a subject area 

7) Giving a talk to a group on reference materials in the library r *s 
collection 1 

i * 1 

t ' * 

8) Coordinating some aspect of reference work with another library * 

9) Compiling a bibliography which requires judgment about th£ qualit$ of 
works included 



1) Which task woulfi you most prefer doing? 
l.l) Why? 



Which would-be your secpnd choice' 

2) Which you least pre/er doing? ' . 
2.1) Why? ' 



3) Which of the tasks do .you consider most professional? . 

3.1) Why? 

3.2) Which would you consider the second most professional task? 

4) Which task do you consider the least professional? 

4,1) Why 
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Section *: ATTITUDES TOWARD INSTRUCTIONAL /INFORMATIONAL REFERENCE 
SERVICE 

Directions: The following two paragraphs describe different approaches 

• to reference work. Read them carefully and answer the follow- 
ing questions in relation to them. The' numbers within each paragraph 
refer to th£ specific thought preceding them* Please disregard them in 
your initial reading; they will be referred to in a question, 

A) I generally prefer to provide the information itself rather than go- 
through the~process of telling the user how to find it, (1) Often the 

* question-answering process is considerably quicker when I do it, (2) And' 
I am a little wary of providing the user with the limited knowledge about 
sources I can give him in a brief encounter; he may feel that all of his 
future questions can be answered through the same strategy when another 
would be more appropriate, (3) Also, I am not sury how important it is 
that he know how to find the information* After all, it is the information 
* itself which is more important, not knowing how t/ f ind it, (ft) 

B) I^would* prefer to introduce someone to the appropriate information 
source* and teach him how to use it rather than provide the answer for 

him, (1) I feel that the patron benefits morefrom finbing the information 
himself rather than its being provided by the librarian, (2) particularly 
in the case of people involved in formal course work, finding* information 
is simply an extension of the courseworkv The librarian should interfere 
in the process only to the point of showing the student where to find it 
and explaining how to use areference book, (3) Even if providing ■ 
instruction is more time-consuming in ^the short-run, ia the long-run the 
patron will make fewer demands on the reference librarian because his own 
* skill in using reference materials will increase, (ft) Developing self- 
sufficiency in using the library should be the goal of every library 
user, (5) ' - 
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Other considerations over which you have.no control^ such £S time 
constraints and institutional policies, influence your behavior ^respond- 
ing to a question. Please disregard these, however^ in answering the 
following questions since the objective Is to develop an accurate picture 
of .your philosophy oT reference service, ■ ; / * 

1) You may disagree with individual sentences in each paragraph, but 
considering each paragraph as a . whole, which more accurately reflects 
your own philosophy of reference services? 

If you are not in complete- agreement with the paragraph you selected, 
vtftich of the sentences or groups of sentences did you disagree with?. 
. (Please note that the sentences are numbered with the number following 
each .sentence. Respond by indicating the specific number of the 
sentence or sentences*) 



1.1) Why? 

* 17 
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2) You may allow for variations in your approach depending on the 

situation. Would your position shift if . you felt the person were -not 
really certain about what he wanted, even after some negotiation of 



•the reference 



quer^j 



* Yes 



V 



) 



No 



3) -IF YOU SELECTED PARAGRAPH A, would your position shift toward 
instruction if the request were generated as a result of formal 
coursework? Yes ~ No 



ERIC 



18 



\ 



Appendix B 



KEY TO SECTION 1, SIMULATED REFERENCE QUESTIONS, AND 
SECTION 2, IDENTIFYING RELEVANT SUB3ECT HEADINGS 



Section 1. SIMULATED REFERENCE QUESTIONS 

t 

1) Yes, as of May 1981, Who's Who in America, 1980, under Berlin, Irving; 
updated by checking in Facts on File or New York Times Index, under 
"Deaths," then in the obituary section in Time, 

Note: The correct answer should indicate updating a standard source. 
Best answer would include the most current news' magazine and perhaps 
the daily newspaper beyond its coverage, A reasonably {jood answer 
would include the New York Times Index or Facts on File, If Berlin 
dies, he should be replaced by a person who would require the same 
strategy, 

2) Galesburg. World Almanac, 1981, under entry of : Counties-U.S. ,^in 
index; Census and Areas and Counties and Seats, Illinois, Knox; p. 961, 

3) Bartlett's Quotations, 14th ed., under Sir Winston Spencer Churchill, 
p. 924b, 3d entry, 

4) Speech Index, 4th ed., p. 1*7, under Churchill, Sir W. L. S. Sinews 
'of Peace (Speech at Fulton, Missouri). The 4 "Iron Curtain Has 
Descended" is the same fl as the Sinews of Peace speech. Six citations 
are given. ' 

5) <U.S. Government Manual% 1979/80, p. 482 ; col. 1, first paragraph, under 

DepartJTjent of Treasury, U.S. Secret Service. 

6) DAB, v ; XI, part 2, Supplements to December 31, 1940, under Root, 
Elihu. 'Article begins on p* 577; actual answer is on p. 581; 1st 
column, 1st paragraph. . 



7) Statistical Abstract, 1977, Table 659,, p. 405, located through 
index 'Under the entry: Employment, Women. * 

According* to this, table, which presents data as of March, 1977> . 
4,435,000 women, .at least 16. years old married with husband 
present and with children under six, were employed in 1977. An 
additional 3£6',ODO women> with same qualifications but 
separated from their husbands^ w*er£ ernployed in 1977. The ' 
correct^answer is' either the'first figure with all qualifications 
or the sum of 'the two 'figures, again with all qualifications.' 
Divorced women should mrt be included r and the figures must be 
in, thousands, which is indicated in a table note. 
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8) PAIS, y* 63 (1977), p, 395, col, 2, under Franklin National 
Bank, second entry* 1 ** 

9) New York Times Index, 1973, under Johnson, Lyndon Baines, funeral / 
service p, 1156, col* 2, f1 2 solos sung 11 . * . If respondent does not 
know that Leontyne Price is black , he may have to verify that* 
Picture of singer is given in Newsweek funeral article. Newsweek, . 
February 5, 1973, p* 32* Reference to this article in Reader's Guide, 
1973/74, under 3ohnson, Lyndon Baines, pp* 571-72* 

, 10) According to the 1979 Ayer's Directory of Publications, pp* 508-09 
• under Missouri— St* Louis, then under newspapers' names: p* 508, 

Globe Democrat, if daily circulation is the criterion; p* 509, if 
Sunday circulation is criterion, the Post Dispatch* Answer varies so 
basis for selection should be given* 




11) Congressional Quarterly Almanac, v. 27 (1971), located in the Index 
under Rehnquist— Supreme Court confirmation, pp* 851-59* 

Major objections are listed on p* 852 under "Other Reactions*" 

j 

12) Congressional Quarterly Almanac, v* 27 (1971), p* ^7-5 in Roll Call 
Votes section, under no* 417, Wisconsin, Proxmire. Proxmire voted 
yes* 

13) Subject Guide >to BIP, 1980, p. 1003, under City Planning--U* $*, 
then browse 'to locate a book by Frederick Steiner, The Politics of 
New Town Planning: The Newfields, Ohio Story, published in 1980* 

» 

14) World Book Encyclopedia, ,v* 3, under Chicago; located'by checking 
index under Picasso* 
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Section 2. IDENTIFYING RELEVANT SUBJECT HEADINGS ■ 

' * ' . 

1) Civil Service— Great Britain—Coionies—India 

2) Bureaucracy ■ 

3) Civil Service Recruit ing—^jndbooKs 

4) Several approaches could be used to broaden the Search: 

\ Recruiting of Employees — would eliminate the Civil Service, aspect 
and include employees in the private sector 
Civil Service Positions'- may ft&scribe the kinds of positions 
available; recruiting could* be treated as a related- topic in a book 

, with this subject heading * 
t Civil Service - very broad. approach. This term is likely to be given 
to books dealing generally wit^tivil SerAjice; any reference to 
recruiting of minority groups fs likely • fflf bg_minimal unless the 
book dealsgenerally ( with t^fe Sivil Service-related problems of 
minority groups., \ 
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